Robust self-localisation and navigation based on hippocampal place cells
نویسندگان
چکیده
A computational model of the hippocampal function in spatial learning is presented. A spatial representation is incrementally acquired during exploration. Visual and self-motion information is fed into a network of rate-coded neurons. A consistent and stable place code emerges by unsupervised Hebbian learning between place- and head direction cells. Based on this representation, goal-oriented navigation is learnt by applying a reward-based learning mechanism between the hippocampus and nucleus accumbens. The model, validated on a real and simulated robot, successfully localises itself by recalibrating its path integrator using visual input. A navigation map is learnt after about 20 trials, comparable to rats in the water maze. In contrast to previous works, this system processes realistic visual input. No compass is needed for localisation and the reward-based learning mechanism extends discrete navigation models to continuous space. The model reproduces experimental findings and suggests several neurophysiological and behavioural predictions in the rat.
منابع مشابه
Image Invariant Robot Navigation Based on Self Organising Neural Place Codes
For a robot to be autonomous it must be able to navigate independently within an environment. The overall aim of this paper is to show that localisation can be performed even without having a pre-defined map given to the robot by humans. In nature place cells are brain cells that respond to the environment the animal is in. In this paper we present a model of place cells based on Self Organisin...
متن کاملمدل شبکه ی عصبی از نگاشت سلولهای شبکه به سلولهای مکانی
Abstract: Medial entorhinal cortex is known to be the hub of a brain system for navigation and spatial representation. These cells increase firing frequency at multiple regions in the environment, arranged in regular triangular grids. Each cell has some properties including spacing, orientation, and phase shift of the nodes of its grid. Entorhinal cortex is commonly perceived to be the major in...
متن کاملReinforcement Learning in Continuous State and Action Space
To solve complex navigation tasks, autonomous agents such as rats or mobile robots often employ spatial representations. These “maps” can be used for localisation and navigation. We propose a model for spatial learning and navigation based on reinforcement learning. The state space is represented by a population of hippocampal place cells whereas a large number of locomotor neurons in nucleus a...
متن کاملGrid cell hexagonal patterns formed by fast self-organized learning within entorhinal cortex.
Grid cells in the dorsal segment of the medial entorhinal cortex (dMEC) show remarkable hexagonal activity patterns, at multiple spatial scales, during spatial navigation. It has previously been shown how a self-organizing map can convert firing patterns across entorhinal grid cells into hippocampal place cells that are capable of representing much larger spatial scales. Can grid cell firing fi...
متن کاملSelf-Organization of Place Cells and Reward-Based Navigation for a Mobile Robot
We investigate a method to navigate a mobile robot by using self-organizing map and reinforcement learning. Modeling hippocampal place cells, the map consists of units activated at specified locations in an environment. In order to adapt the map to a realworld environment, preferred locations of these units are self-organized by Kohonen’s algorithm using the robot’s actual position data. Then a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Neural networks : the official journal of the International Neural Network Society
دوره 18 9 شماره
صفحات -
تاریخ انتشار 2005